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ABSTRACT 

California Assembly Bill 1725 requires the 
development and implementation of a comprehensive community college 
educational and fiscal accountability system. In response to the 
bill, the Chancellor's Office (CO) of the California Community 
Colleges is moving away from its traditional functions of compliance 
and regulatory activity toward establishing an accountability 
structure based on student outcomes and district results rather than 
input measures. An accountability program has been developed which 
centrally collects information on college outcomes related to student 
access, student success, student satisfaction, staff composition, and 
fiscal condition, but also recognizes the importance of locally 
designed and managed accountability efforts. Obstacles have been 
identified to implementing the accountability program, including the 
variance in local management information system capabilities, uneven 
local research competence, local skepticism, and a patchwork of 
existing burdensome statewide reporting requirements. The CO ! s 
proposal for overcoming these obstacles includes the following five 
components: (1) the annual publication of a statewide accountability 
indicators report; (2) annual in-depth studies of individual 
accountability areas; (3) periodic statewide surveys to assess 
student satisfaction; (4) more effective data collection and 
dissemination; and (5) disseminating exemplary accountability models 
and providing technical assistance to districts. A work-in-progress 
version of the accountability indicators report and a table of 
non-participating districts are appended. (MAB) 
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Issue 

This item describes work in progress on the accountability system required by 
Assembly Bill 1725. It is intended as a brief review of the history of this account- 
ability system and as a preliminary look at the report that is required by the end of 
the 1993-94 year. 



Background 

Assembly Bill 1725 requires the development and implementation of a comprehen- 
sive community college educational and fiscal accountability system. This system 
will produce a published report of California Community Colleges' accountability by 
the end of 1993-94. 

Analysis 

The Chancellor's Office is moving away from the role of a state agency whose princi- 
pal functions are compliance and regulatory activity. It is establishing an account- 
ability structure that is based on student outcomes and that holds districts account- 
able for results rather than input measures. 

The initial design of the accountability program called for the centralized collection 
and reporting of information in five areas: student access, student success, student 
satisfaction, staff composition, and fiscal condition. Colleges were to report to the 
Chancellor's Office primarily via the Management Information System. 

Subsequent planning emphasizes the importance of viable, local, college-level 
accountability and institutional effectiveness programs to support and complement 
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the statewide program. The California Community Colleges' effectiveness as a whole 
depends on the effectiveness of each individual college. Locally designed and 
managed accountability programs are needed to serve the needs of particular 
colleges. A viable accountability program uses information to integrate planning, 
implementation, and evaluation of state and local programs for continuous improve- 
ment of teaching of students and learning. 

In January 1991, the Chancellor's Office convened a task force and awarded grants 
for an accountability pilot program to four community college districts. The final 
task force report made three recommendations: 

1. Improve the capacHy of colleges for institutional research and 
management information system activities that are necessary for 
accountability and institutional effectiveness. 

2. Implement the statewide plan that was developed in a study of 
accountability program costs. 

3. Improve college and Chancellor's Office access to statewide data bases 
that contain employment and transfer information. 

The Chancellor's Office is working in a number of areas to implement the statewide 
accountability program; staff are coordinating accountability requirements for 
vocational education, adult education, and student equity. The Planning, Effective- 
ness and Accountability Unit has consulted with the California Postsecondary Edu- 
cation Commission, the Chief Executive Officers Council, the Chief Instructional 
Officers Council, the Council of Organizations, the Academic Senate, and the Com- 
munity College League of California. The Chancellor's Office continues to provide 
technical assistance to local colleges in the development of their own institutional 
effectiveness and accountability programs. 



Conclusion 

This report features those accountability indicators that are currently available, 
including credit enrollment, noncredit enrollment, transition from high school, 
persistence from term-to-term, successful course completion, and attainment of 
degrees and certificates. These indicators demonstrate the capability of the Manage- 
ment Information System to provide useful information for the accountability pro™ 
gram. Although a brief commentary accompanies the data, more probing analyses 
will be conducted. 

In time, additional data will become available to measure the success of the system to 
support transfer to four-year institutions, vocational education, and job training. The 
Chancellor's Office has already begun a long-term effort to document student 
transfers. The Employment Development Department (State) is cooperating in a 
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study of wage record data that will document the success of students in obtaining 
jobs. 

Apart from the AB 1725 accountability mandate, there are additional compelling 
reasons for promoting accountability. First, in the current difficult fiscal climate it is 
important to focus on effectiveness, As with any organization, the community 
colleges can be more effective if they can objectively document how well they have 
attained their goals. Second, with heightened competition for public money, it is 
important to foster strong public support for community colleges. Open communi- 
cation of educational and fiscal conditions helps to strengthen public support and 
confidence in the colleges. Therefore, to embrace accountability satisfies a basic 
obligation to the welfare of the community colleges. To be accountable reaffirms the 
public's trust, and it promotes better service to California's students who now, more 
than ever, need a strong community college system. 



Staff: Mark Fetler, Ph.D. t Specialist 

Planning, Effectiveness and Accountability Unit 
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AB 1725 Accountability 
Work in Progress 



Introduction 

Public interest in accountability for schools and colleges continues to grow. There are 
a number of new state and federal programs that include accountability require- 
ments. For example: 

• The Higher Education Accountability Program Act of 1991 (AB 1808, 
Chapter 741, Statutes of 1991, Education Code Section 99181) requires the 
California Postsecondary Education Commission (CPEC) to develop and 
adopt a format for an annual report on the performance of public colleges 
and universities. 

• CPEC, in 1993 became the State Postsecondary Review Entity, acting for 
the federal government, with strengthened student aid program oversight 
powers. 

• The 1993 report of the Commission on Innovation, Choosing the Future: An 
Action Agenda for Community Colleges, recommends restructuring commu- 
nity college governance to enhance local autonomy, strengthen system-level 
capacity to provide overall direction, and reinforce accountability. 

• The federal government has strengthened accountability requirements in 
the Carl D. Perkins Vocational and Applied Technology Education Act 
Amendments of 1990. 

• The National Collegiate Athletic Association and the federal government 
have linked public disclosure of student outcomes to institutional 
participation in financial programs. 

• The California Community Colleges Board of Governors recently adopted a 
student equity program that includes a local college accountability 
component. 



State and Local Programs 

The Chancellor's Office is moving away from its role as a state agency whose 
principal functions are compliance and regulatory activity. It is establishing an 
accountability structure that is based on student outcomes and that holds districts 
accountable for results rather than input measures. 
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The initial concept for the accountability program called for centralized collection 
and reporting of information in five areas: student access, student success, student 
satisfaction, staff composition, and fiscal condition. Colleges were to report to the 
Chancellor's Office primarily through the Management Information System. 

Subsequent planning emphasizes the importance of viable, local, college-level 
accountability and institutional effectiveness programs to support and complement 
the statewide program. The California Community Colleges' effectiveness as a whole 
depends on the effectiveness of each individual college. Locally designed and 
managed accountability programs are needed to serve the needs of particular 
colleges. A viable accountability program uses information to integrate planning, 
implementation, and evaluation of state and local programs for continuous 
improvement of teaching of students and learning. 

In January 1991, the Chancellor's Office convened a task force and awarded grants 
for an accountability pilot, program to four community college districts (Santa 
Barbara, San Joaquin Delta, Mt. San Antonio, and San Jose-Evergreen). These 
grants permitted the development of local accountability reports. The local projects 
provided a framework to integrate planning, research, administration, and 
instruction. The districts used the grants to hire technicians, to develop hardware 
and software systems, and to participate at various conferences and planning 
sessions. 

The Chancellor's Office contracted in 1991 with Far West Laboratory to write a 
technical assistance guide, "Improving It: Accountability by Design," which offers 
guidelines for educators who wish to design systems for improved institutional 
productivity and effectiveness at local community colleges. This booklet treats 
accountability as an opportunity for colleges to verify to themselves and others what 
their institutions are accomplishing and to design ways to monitor and ensure 
continued success. The guide is not prescriptive; it helps institutions evaluate their 
capability to assess their effectiveness, and it poses program design issues that staff 
will need to decide for themselves. 

The rationale and design of a statewide accountability program derives from a 1991 
cost study, "California Community College Accountability: State and Local 
Implementation Costs," produced by Strategic Planning Associates under a contract 
with the Chancellor's Office. The study drew on interviews with the officials of the 
Chancellor's Office, the Office of the Legislative Analyst, the Department of Finance, 
the California Postsecondary Education Commission, the pilot program members, 
and ten additional community college districts. 

The cost study described obstacles to a state program and strategies for overcoming 
them. The four main obstacles to accountability are: (1) great variance in local 
management information system capabilities, (2) uneven local research competence, 
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(3) local skepticism, and (4) a patchwork of existing burdensome statewide reporting 
requirements. 

The overarching strategy to overcome these obstacles is to obtain local funding for 
college programs. However, local funding for accountability programs, as well as 
funding for a modest Chancellor's Office program, awaits a more favorable fiscal 
climate. The Chancellor's Office proposal has five components: 

1. Statewide accountability indicators report. The Chancellor's Office will 
annually compile information from the Management Information System and 
other routinely collected data. 

Status: A work-in-progress version of the report is included in this Board item. 
It demonstrates the ability of the Chancellor's Office to collect and display basic 
accountability information. 

2. Annual in-depth accountability studies. These studies would complement the 
indicators report by providing a detailed understanding of a single 
accountability area. 

Status: This activity requires additional resources. 

3. Statewide surveys. The Chancellor's Office will periodically commission scien- 
tific sample surveys to assess student satisfaction. 

Status: This activity requires additional resources. 

4. More effective data collection and dissemination. The Chancellor's Office will 
develop a long-range plan to reduce the response burden placed on districts by 
multiple information demands. 

Status: Program units in the Chancellors Office are reviewing data collection 
procedures. Recent discussion of proposals for regulatory relief should result in 
less burdensome reporting by colleges. Within the Chancellor's Office, staff are 
coordinating the development of accountability requirements for vocational edu- 
cation programs and student equity programs. The Planning, Effectiveness and 
Accountability Unit has consulted with the California Postsecondary Education 
Commission on the design of the intersegmental accountability program required 
by the Higher Education Accountability Program Act of 1991 (AB 18081 

5. Depository and/or Clearinghouse. The Chancellor's Office will serve as a 
depository for exemplary accountability models and will provide technical 
assistance to districts. 

Status: A newsletter. "Planning, Effectiveness & Accountability/ 9 appears 
monthly and provides technical information to colleges. 
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Current Activities 

The Planning, Effectiveness and Accountability Unit havS worked to communicate 
information about the Chancellor's Office accountability programs and to coordinate 
and streamline the development of those accountability programs, The primary 
opportunities for such communication and cooperation are through conference 
presentations, participation in Chancellor's Office committees, and participation in 
external agency committees, Following is a list of activities that have taken place 
during the past year* 

Conference Presentations 

Understanding the State Accountability System. Academic Senate for 
California Community College's 25th Annual Fall Session. (Panel discussion, 
November 1993) 

Institutional Accountability in California Community Colleges. Annual Confer- 
ence of the Community College League of California, Rurlingame, (Panel dis- 
cussion, November 1993) 

California Association for Institutional Research Annual Conference. (Panel 
discussion of models for cooperation between higher education and K-12, 
November 1993) 

Introduction to the Internet. Research and Planning Group workshop at Solano 
Community College. (A discussion of Internet technology and ways that it can 
serve accountability programs. June 1993) 

Learning Networks: A Cross-Agency Information System to Increase Learner 
Access. Annual Student Services Conference of the Chancellor's Office, Irvine, 
(Panel discussion of technology for collecting and reporting program and 
learning information. June 1993* 

Data for Decisions: Putting Accountability to Work. Annual Student Services 
Conference of the Chancellor's Office, Irvine. (Panel discussion, April 1993) 

Data for Decisions: Putting Accountability to Work. Annual Conference of the 
Community College Research and Planning Group, Lake Tahoe, (Workshop, 
March 1993) 

Chancellor's Office Committees 

Student Equity Planning Committee. Coordinates accountability data collection 
to avoid any duplicative, unnecessary, or burdensome reporting of data by 
colleges. (Ongoing in 1993-94) 
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Matriculation Technical Advisory Group. Monitors local college matriculation 
assessment programs and the types of information of relevance for local 
accountability programs that these programs produce. (Ongoing in 1993-94) 

Adult Education Learning Network Task Force. Monitors the design of program 
information and learner information data bases that may be developed for adult 
noncredit education programs of relevance for local accountability programs. 
(Ongoing in 1993) 

Vocational Education Committee of Practitioners. Assists in the coordination of 
the design of vocational education accountability programs with other Chancel- 
lor's Office accountability programs in order to avoid any duplicative, unneces- 
sary, or burdensome reporting. (Ongoing in 1993) 

Intersegmental Coordinating Council Committees 

California Student Information System. Assists in the coordination of the 
design of an Electronic Data Interchange (EDI) system that would span K-12 
and higher education in order to avoid any duplicative, unnecessary, or 
burdensome reporting. (Ongoing in 1993-94) 

School Improvement Committee. Monitors the development of programs for 
collaboration of K-12 and higher education, particularly with regard to 
accountability and assessment requirements. (Ongoing in 1993) 

Time to Degree. Assists in the development of a report that makes recommen- 
dations for intersegmental reporting on the time students require to earn 
degrees. (Ongoing in 1993) 

California Postsecondary Education Commission Higher Education Account- 
ability Report Advisory Committee (AB 1808). Coordinates with CPEC in the 
design of a higher education accountability system. (Spring 1993) 

CalPlan Vocational Education Committee of the Community Colleges and the 
Department of Education. Provides input with regard to accountability and 
assessment for the design of a strategic plan for vocational education. (Ongoing 
in 1993) 

Community College League of California Education Policy Committee. Dis- 
cusses Chancellor's Office accountability programs. (January 1994) 

Commission on Innovation. Provides input regarding Chancellor's Office ac- 
countability programs. (Ongoing in 1993) 
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Statewide Report 

The reporting of performance indicators is an essential part of the accountability 
program. Broadly defined, an "indicator" is a measurement of the educational or fis- 
cal condition of the California Community Colleges. There are numerous indicators 
of potential interest to various stakeholders, but the interests of statewide governing 
bodies and the burden of data collection limit how much information can be reported. 
Local colleges may wish to supplement the statewide indicators with additional 
measures of local conditions. The following statewide report is primarily based on 
data available from the Chancellor's Office Management Information System Unit. 
The Appendix displays which colleges have or have not provided the information 
required for this report. Other sources of data were the Chancellor's Office Fiscal 
Data Abstract and files maintained by the Fiscal and Business Services Unit. 

Purely descriptive information that does not provide an opportunity for comparisons 
has limited value for analytical, evaluative, or accountability purposes. Where pos- 
sible, statewide results will be disaggregated and shared with local districts; how- 
ever, the interpretation of local results should rest with the district. College demo- 
graphics vary across many dimensions that are not covered in a statewide report, e.g., 
the socioeconomic level of the populations that are served. 

There are some limitations on the interpretation of the statewide data. Ideally, every 
college would provide complete information every year. In practice, when some 
colleges do not report there is a possibility of bias in the statewide results. That is, 
the reason for not reporting may be correlated with the measures being reported. 
Even commonly accepted procedures for correcting such bias are not completely 
effective and they complicate the interpretation of data. A related problem is found 
in the relatively large number of students who do not report their ethnicity. This 
non-response also raises the issue of bias and the problems associated with the 
attempt to make adjustments in the data. In any case, attempts to correct for bias are 
time consuming, are difficult to interpret, and may not be successful. The preferred 
solution is to obtain higher levels of response from colleges and students. The 
currently available data should not be used )br longitudinal trend analysis. Once 
college participation in the Management Information System has become universal 
and of consistently high quality, longitudinal trend analysis will be one of the main 
benefits derived from both statewide and local college accountability data. 



Conclusion 

This report features accountability indicators that are currently available, including 
credit enrollment, noncredit enrollment, transition from high school, persistence 
from term-to-term, successful course completion, and attainment of degrees and 
certificates. These indicators demonstrate the capability of the Management 
Information System to provide useful information for the accountability program. A 
record of which colleges have or have not provided information required for this 
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report is appended. Although a brief commentary accompanies the data, more 
analyses will be conducted. 

Apart from the AB 1725 accountability mandate, there are additional compelling 
reasons for promoting accountability. First, in the current difficult fiscal climate it is 
important to focus on effectiveness. As with any organization, the community 
colleges can be more effective if they can objectively document how well they have 
attained their goals. Second, with heightened competition for public money, it is 
important to foster strong public support for community colleges. Open communi- 
cation of educational and fiscal conditions helps to strengthen public support and 
confidence in the colleges. Therefore, to embrace accountability satisfies a basic 
obligation to the welfare of the community colleges. To be accountable reaffirms the 
public's trust, and it promotes better service to California's students who now, more 
than ever, need a strong community college system. 
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